Gap Generation in Topological Insulator Surface States by non- Ferromagnetic 
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It is shown that, contrary to the naive expectation, single particle spectral gaps can be opened 
on the surface states of three dimensional topological insulators by using commensurate out- and 
in-plane antiferromagnetic or ferrimagnetic insulating thin films. 
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Introduction. One of the most remarkable proper- 
ties of a three dimensional topological insulator is the 
presence of a topologically quantized magnetoelectric 
term (TMET) in its electromagnetic response. This 
term has far reaching consequences since it constitutes a 
condensed- matter realization of axion electrodynamics 0, 
Q. Experimental signatures of the TMET include the 
quantized Kerr angle and Faraday rotationJ3|-l5| , Casimir 
repulsion inverse spin galvanic effectJH, monopole 
images 0, surface half integer Hall effect [J, topological 
viscoelastic response fiojj just to name a few. 

The key point for the observability of this topologically 
quantized response is the breakdown of the time reversal 
symmetry in the surface of the otherwise time reversal 
invariant T±l9j. In terms of the electric and magnetic 
fields, the TMET in the electromagnetic action takes the 
form 




FIG. 1: (Color online). Low energy spectrum of the surface 
states of a TI in homogeneous in-plane magnetization. Red 
arrows show the direction of the magnetization field. 
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where a is the fine structure constant and 9 is the so 
called axion parameter which takes the value of or 
(2n + 1)tt with n € N in trivial and topological insulators, 
respectively @. Alternatively to the above description in 
terms of the electromagnetic fields, one can understand 
the TMET as a Chern Simons (CS) term induced in the 
electromagnetic response of the insulator by the gapped 
surface states of a TI that are described by usual massive 
Dirac Hamiltonian: 



Hd = v (er x k) • z 



mo. 



(2) 



where v is the Fermi velocity, and m is the induced mass 
of the Dirac states. In this case, the value 9 = it corre- 
sponds to the value a = isign(m) for the Hall coefficient 
in the corresponding CS term. In short, breaking time 
reversal symmetry opens a gap in the TI surface states, 
thus making the TMET observable. 

Within the effective low energy approximation de- 
scribed by ([2]) there are several proposals in the liter- 
ature for opening a gap in the helical metal by means 
of weak magnetic fields through a Zeeman term Hz = 



g[iB& ■ B[ll|, or through exchange coupling to ferromag- 
netic thin films H exc = JM • crjjjj], and magnetic im- 
purities H imp = JJ2j S j ' ~ Rj)[l%Jl4|. The ex- 
change coupling between magnetic thin films and TI is 
the most appealing from the theoretical point of view 
because it not only gives a simple mechanism to develop 
the theory of the TMET but it allow us to look for unex- 
pected effects that can alter the thin film magnetization 
dynamics^, EH]. However, this proposal is experimen- 
tally challenging, and also it poses some questions. First 
of all, it is not so easy to find insulating ferromagnetic 
materials. Some candidate materials like GdN and EuO 
have been theoretically suggested 0, 0] but to the best of 
our knowledge so far there is no experimental evidence 
supporting this claim. Also, even if ferromagnetic in- 
sulating thin films were available, it is not guaranteed 
that the thin film magnetization would point in the out- 
of-plane direction [l6|. There is the problem of possible 
mismatch between the TI surface lattice structure and 
the thin film lattice structure and even the issue of the 
two lattices not being commensurate. These problems 
are in the heart of the experimental difficulties for imple- 
menting this mechanism. 

Directly using eq.(f2]) implicitly forces us to consider 
a continuum medium approach for the magnetization 
[ljJ.The question is then how to construct this effective 
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FIG. 2: a): Exchange induced gap m (in units of Bn) on the TI surface states vs. the lattice mismatch Sy. Blue (solid), 
red (dashed), and green (dashed-dotted) lines corresponds to ferromagnetic, antiferromagnetic, and ferrimagnetic lattices, 
respectively For the ferrimagnetic configuration Si = — 5S2 and /3 = 0.02a 2 . b): The effective Zeeman field on the surface as 
the function of the relative displacement Sy between the magnetic and the TI lattices and the localization parameter j3. c): 
Real space configurations for the TI surface. Black dots represent lattice Se positions and the arrows correspond to a hexagonal 
antiferromagnetic lattice. 



description of the exchange coupling between the sur- 
face electronic spin and the magnetization starting from 
a microscopic model. For ideal insulating ferromagnets 
the most naive way would be to couple the electron spin 
with the averaged magnetization in the magnetic unit 
cell. However when more realistic magnetic insulators 
are considered we immediately run into difficulties. For 
instance this approach automatically rules out the possi- 
bility of considering antiferromagnetic insulators as mag- 
netic material candidates. Also it is not at all clear what 
the correct form for a continuum description of the mag- 
netization of a ferrimagnetic insulator is. Motivated by 
these experimental and theoretical issues, we address in 
this work the problem of coupling a magnetically active 
thin film with the surface electronic states of a TI em- 
ploying an tight binding approach. 

The model. In order to study qualitatively the ways 
in which the gap can be microscopically induced in the 
surface spectrum we will employ a tight binding model 
valid for the topological insulators of the form 1^2X3 
which include the prototypical examples of TI's Bi2Sc3 
and Bi2Te3. We will then follow references 18, lj| and 
will consider a Bi2Se3 sample made of N quintuple lay- 
ers (QL) grown in the (111) direction and terminated 
in Se planes. The surface will thus have a triangular 
lattice structure. We are interested in the bandstruc- 
ture around the Fermi level so the tight-binding basis 
set will be made of linear combinations of the atomic 
orbitals ( \p% % , f) , \p Se > t) , \pti > I) > \Pse > D) ■ The super- 
script reflect the parity of the state and the second index 
is the spin polarization. The tight binding Hamiltonian 
in real space can be written in this basis in the following 
way 
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CiWb.Cn+ai/bi +H.C.(3) 



Here the lattice vectors and connect unit cell posi- 
tions within the same QL and of different QL, respec- 
tively and n labels the lattice positions as defined in 
EE O- We use a = I a, I as the lateral spatial length 
scale. The on-site energy e and hopping terms t a ./ b . are 
4x4 matrices which can be written as linear combination 
of matrices which are matrix products of spin er and 
parity r Pauli matrices: 



e = e r + ™r 5 , 

£ ai = A T Q - i(A u T 3 - A lA T 2 ) + A n T 5 , 
tbt = B Q T Q + i(B 12 r 4 — Bi 4 ri) + BxiT 5 , 

Li, 2 = n ® 0-1,2, r 3 = ti ® 0-3, 

T4.5 = 72,3 ® CT , r = T ® a . 



(4) 



The remaining hopping matrices i £ 



2,3/^2,3 



can be ob- 



tained from Q by applying the rotation operation R3 = 
exp(i-|<73 <E> To). The Hamiltonian ([3]) is thus made of 
intra-QL hopping terms and on-site energies and hop- 
ping terms coupling different QL. In all calculations pre- 
sented here we use Bn = 1, A14 = 1.4, A i2 = Bx2 = 3, 
An = 2, m = — 10, Bu = Aq = Bo = 0, for modelling 
a bulk TI[19|.Next we add a exchange term coupling to 
the Se atomic orbitals in ([3]) of the first QL of the form 



(5) 



n,ai /hi 



where The matrices S are of the form S = 
\ (to — t 3 ) <g) <x and now R n represent the lattice posi- 
tions of the Se atoms in the outer part of the first QL. 
The important observation here is that the magnetic and 
surface lattices do not need to be the same for generic 
magnetic layers so the magnetic moment of the magnetic 
layer S(R n ) at R n will not be the magnetic moment of 
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each magnetic position. Usually the magnetic moments 
represent the magnetic moment associated to a bounded 
atomic orbital with a short spatial extension so not all 
the magnetic moments will couple in the same manner to 
the electronic spins on the surface and the coupling will 
be stronger for nearer atoms. The two previous observa- 
tions lead us to define S(R n ) as 



S(R n ) = ^S(R l )$(R„-R ! 



(6) 



where now the sum is performed over the magnetic lat- 
tice positions. The function $ encodes the information 
about the short range character of the localized magnetic 
orbitals. In our calculations we have chosen a Gaussian 
profile, $(r) = e~ r l& parametrized by the parameter (3 
which has the meaning of the (squared) mean size of the 
spatial profile of the magnetic orbital. We have checked 
that any other choice for $ does not modify the qualita- 
tive results presented in this work. It is important to note 
that for a given Se position, nearby moments will con- 
tribute to S(R n ) but not equally if there is a mismatch 
between the two sublattices. This key observation is in- 
teresting because it opens the possibility of considering 
not just ferromagtetic, but also other types of magnetic 
ordering as a candidate for inducing gaps in the TI sur- 
face states by the exchange coupling mechanism. 

Results. In order to show the ideas explained above at 
work, let us consider first the case where the positions 
of the magnetic lattice lie in the middle of the triangles 
formed by the surface lattice as it is shown in Fig.([2j;) and 
calculate the spectrum with eqs (HHU) . We will control the 
mismatch between the lattices by displacing a magnetic 
bipartite lattice a distance Sy with respect the center 
of the triangle in the OY direction, and we will consider 
the three cases of ferromagnetic (Si = S2), antiferromag- 
netic (Si = — S2) and ferrimagnetic (Si = — 5S2) out of 
plane configurations. In Fig. ([2^,) we show the value of 
the gap defined as m = | min[_E c (k)] — max[_E tI (k)]|/2. 
For the ferromagnetic case, the system always develops 
a non zero gap, as expected, irrespective of the relative 
position of the two lattice sites. The modulation in the 
value of the gap is understood in terms of the differ- 
ent contribution of the magnetic moments to S e jy(Rj). 
Much more interesting are the cases of ferrimagnetic and 
antiferromagnetic lattice structures. The first important 
observation is that in both cases a gap is opened when 
varying the relative position of the lattices, showing that 
in principle one can open gaps in the TI surface states 
by the interaction with ferri- and antiferromagnetic lay- 
ers. In principle, nothing guarantees that the magnetic 
lattice sites must lie on the exact center of the triangles 
formed by the surface positions, but the gap might be 
still open. Moreover, if during the fabrication process 
it were possible to control the lattice mismatch, the gap 
could be tuned. Another important observation is that 
although to is a positive definite quantity by construc- 



tion, the value of the effective Zeeman coupling is not. 
Indeed it will change its sign, as it is shown in fig.([2p), 
where the effective Zeeman term is plotted as a function 
of the lattice displacement <5y and the value of (3. This 
result means that for the case of ferrimagnet different rel- 
ative displacements might lead to different values of the 
coupling, which is the signature of a topological phase 
transition, controlled by <5y. This is also true for generic 
antiferromagnetic configurations. As can be readily seen 
in fig. ((2t>) there is always a change of sing of S e // irre- 
spective of how tight are the magnetic atomic orbitals to 
their lattice sites. 

So far, we have considered magnetic configurations in 
thin layers with the magnetization being out-of-plane. It 
is well known that when thin film geometries are consid- 
ered for ferromagnets it is more energetically favorable 
for the system to have the magnetization in plane 16 , 2^] ■ 
From the form of ([2]) an in-plane homogeneous magneti- 
zation would not induce any gap since an in plane mag- 
netic moment would just shift the position of the Dirac 
point. Actually this is not the case and a gap can be 
induced when lattice effects are considered in addition to 
([2]) as it was shown by Fu[2l|. We can add to ([2]) the two 
next to leading terms in the expansion in momenta[21|: 



H w = 



2mo 



cr + ak 2 (<x x k) • z + A - ik x k 2 y ) a z , (7) 



where m , a, and A come from the comparison between 
the band structure calculated from the tight binding 
and ARPES measurements [22|. When the Hamiltonian 
Hd + H w is considered together with H exc — J||CT||m|| , it 

j3 

is apparent that a gap of value 771 = A^- (rriy — Striy-m 2 ,) 

appears at k g = ^-m|| x z as it is shown in fig.([T]). Apart 
from the mass generation due to the hexagonal terms 
there is a self-doping effect defined through the param- 
eter n = |min[i? c (k)] + max[EV,(k)]|/2 due to the first 
term in ([7|). The effective model Hd + H w + H exc can 
be considered as a good description for the interaction 
between the TI surface states and smooth varying ferro- 
magnetic in-plane magnetization. However, as we argued 
before there are many materials where the magnetization 
varies at the order of the lattice spacing and the above 
effective description cannot be directly applied. Even in 
such cases, a non vanishing gap can be found if one goes 
to the microscopic description of the system. 

We will exemplify this situation considering the 
Kagome lattice with classical planar magnetic configu- 
rations. The magnetism on this frustrated lattice is a 
current subject of research [23). In particular we have 
chosen the q — and q — \/3 x a/3 ground state spin 
configurations as plotted in the insets of Fig. ([3]). In or- 
der to monitor the evolution of the spectral properties of 
the system we have chosen the lateral displacement <5x 
between lattices in the OX direction as a control param- 
eter. In this way the magnetic moment sitting on the 
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FIG. 3: Evolution of the gap a) and the self doping b) as 
a function of the mismatch <5x between the two sublattices, 
as it is explained in the text. Insets correspond to magnetic 
configurations with <5x = 0. 



horizontal axis will play a dominant role. The results 
for the gap and for the self doping are also displayed in 
Fig-©- We can easily understand the results by keeping 
in mind that the exchange interaction between magnetic 
moments and electron spins is short ranged and the be- 
havior of the gap with the magnetic moment components 
according to the Fu's model. In the inset of fig.(j3^,) the 
red sublattice magnetization points along the OY direc- 
tion so the gap will open when this sublattice magneti- 
zation is closest to the atomic lattice. On the contrary, 
in the inset of Fig.([5}D) the red sublattice magnetization 
points along the OX axis so according Fu's model, no 
gap will be generated. Also, it is expected that both 
configurations will give rise to a non vanishing self dop- 
ing effect when the effective magnetization is non zero as 
it is shown in Fig.(|3j3). Another important observation 
is that different in-plane magnetic configurations in adja- 
cent space regions (Neel domain walls |24|) might induce 
a mass with opposite sign which would generate chiral 
ID fermionic states. 

Experimental feasibility. One of the proposed ferro- 
magnetic insulators is the EuO[25j]. It possesses a gap 
of the order of 1.2eV and it crystallizes in the simple 
cubic structure, not commensurate to the triangular lat- 
tice structure of the surface, introducing further com- 
plexity in the problem. In contrast to ferromagnetic in- 
sulators, ferrimagnetic insulators offer more reliable ex- 
perimental opportunities. The ferrimagnetic insulating 
state is present in Nature in many compounds and in 
many crystalline structures, and ferrimagnetic thin films 



can be manufactured in many ways|26|. Among them we 
highlight the hexagonal ferrites of which PbFe^Oig is 
the archetypal material. They crystallize in the hexago- 
nal magnetoplumbite structure having a rather complex 
atomic configuration. Many other ferrites grow in the 
spinel structure, like the magnetites (Fe304) and Cobalt 
ferrites (CoFe204) that might be grown in thin films 
with appreciable out-of-plane magnetization 27] . Al- 
though CoFe204 have a strong mismatch between the 
magnetic and the Se lattice structure and the results pre- 
sented here are not directly applicable we suggest it as 
prospect candidate for experimentally analyzing the ef- 
fect of ferrimagnctism on the surface states of a TI. Con- 
cerning in-plane magnetic configurations, we can mention 
Kagome systems with different planar spin ground states 
like SrCrgGasOig, herbersmiththite, jarosite and many 
others [H| . 

Conclusions. In the present paper we have addressed 
the question if the effective Hamiltonian © is valid when 
the helical surface states of a TI are coupled to magnet- 
ically active layers, . By using a tight-binding model for 
both the TI and the magnetization, we have shown that 
contrary to the (perhaps too) naive expectation that the 
helical spin couples to the total magnetization present in 
the unit cell, it couples to a weighted average of the mag- 
netic moments present in the unit cell. This result tell us 
that in principle, there is no physical reason for ruling out 
antiferromagnetic insulating thin films as candidates for 
inducing gaps in TI surface states. We have considered 
also the possibility of ferrimagnetic insulating thin films. 
In all the cases, we have shown that the magnetic ex- 
change mechanism induces a gap in these surface states. 
As a result, we have found that the gap is sensitive to 
the mismatch between the magnetic and surface lattices. 
We have considered also the realistic situation where the 
film magnetization is in-plane and homogeneous. In this 
case, a gap might be opened due to hexagonal warping 
effects [2l| even for materials whose thin film magnetiza- 
tion is textured at the scale of the lattice spacing, induc- 
ing a zero average magnetic moment per unit cell. 
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